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Abstract. Based on a reconsideration of the Gibbs paradox, we show that a residual, 
non-extensive term in entropy turns up upon mixing identical particles, whether they 
are indistinguishable or not. The positive contribution from this residual entropy leads 
to a decrease in free energy, and we suggest that this entropic mechanism may serve as a 
source of like-charge attractions between a pair of colloidal particles or other macroions. 
For a system of two colloidal particles along with their neutralizing counterions, such 
decrease in free energy is of a few thermal energies and therefore crucial to the effective 
interaction between the particles. 
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1. Introduction 

The phenomena of the so-called "like-charge attraction" among colloidal particles have 
been observed since the last decade[U [21 [3J 111 13 El [7J . It was first observed in a solution 
that is confined between glass walls with a narrow separation [H El [3] as well as metastable 
colloidal crystals[5], as quite recently like-charge attraction was also observed in bulk 
colloidal solutions [HI [TJ. The range of attraction is comparable to the colloidal size, 
which is in the order of one micrometer. This relatively long-range attraction among 
colloidal particles, which cannot be explained through the use of van der Waals force, 
is generally believed to result from electrostatic origin. Meanwhile, similar effects of 
like-charge attraction have been observed in polyelectrolyte solutions[8l |9~1 ITU] and other 
macroionic systems [TT1 [12] as well. While no definite answer is given, mechanisms of 
the attractive force among these mesoscopic objects have been proposed by the Sogami- 
Ise theory [131 EE]) the collective fluctuations of counterions[15l [TUl [16], possible charge 
inversions in colloids[I7], and even hydrodynamic effects of the confining glass plates [T8]. 

In this work we introduce a possible mechanism to account for the like-charge 
attraction based on entropic considerations. To do this, necessarily one needs to go 
through, with caution, the statistical definition of entropy, as well as the debate it has 
introduced in the past. We shall start our discussion with a review on the well-known 
Gibbs paradox [ini [201 EI]. 



2. Gibbs paradox revisited 

First let us review the Gibbs paradox with a simple lattice model. Consider iV identical 
particles distributed among V lattice sites in a container. We assume no interaction 
except volume exclusion, such that each site can be occupied by at most one particle. 
According to the Boltzmann entropy formula one has 

S = k B In jy^y_ ~ k B [V In V - N - (V - N) ln(V - N)] (1) 

with the use of Stirling's approximation V\ ~ Vln V — V and so on. If one joins two 
such containers together (as illustrated in Fig. [[]), the total entropy of the combined 
system before the removal of the partition is 

Sa = 2S « 2k B [V In V - N - (V - N) \n(V - N)] . (2) 

After removing the partition the total Boltzmann entropy becomes 

(2VV 

S B = k B ln , 2 y_ 2N)] « k B [2V \nV-2N-2(V -N) ln(^-iV)+2iVln2] , (3) 

and hence the change in total entropy is 

AS ~ 2k B N In 2 . (4) 

The above result shows two 'unwanted' features. First, being non-extensive, 
Boltzmann's statistical definition matches the thermodynamic entropy with difficulty. 
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Figure 1. Illustration of the Gibbs paradox and its analogy in a system of two colloidal 
particles. Case A refers to a unmixed bisected state, while case B refers to the state 
where the bisecting partition is removed, or the mixed state where counterion clouds 
come close. 



Second, the total Boltzmann entropy increases after the partition is removed. Since 
thermodynamics tells us that the state of the system (described through density, 
pressure, total number of particles, etc.) remains unchanged by the removal of the 
partition, this increase implies that the Boltzmann entropy cannot be an appropriate 
thermodynamic state variable. Moreover, if one suddenly re-inserts the partition into 
the system, such that no work is done, the total Boltzmann entropy drops back down 
to its original value. This again violates thermodynamics, where entropy can only be 
reduced through work and discharge of excessive heat in reversible processes, and must 
increase in irreversible processes. 

To resolve the Gibbs paradox and therefore define a statistical entropy that can 
be identified with the thermodynamic entropy, one replaces in the Boltzmann entropy 
formula the total number of configurations with the total number of 'distinguishable' 
configurations. Thus in classical cases (in which no two particles can have exactly 
the same coordinates in the phase space) one puts an extra 1/JV! factor, while in 
quantum statistical mechanics one does the counting in a way that incorporate this 
indistinguishability inherently. 

Statistical mechanics, or at least its classical version, is in fact a science concerning 
one's impression. If the particles on the two sides of the partition are distinguishable, 
e.g., the particles on the left are red and the particles on the right are green, the total 
entropy should increase after the partition is removed. This increase in entropy, and 
thus decrease in Helmholtz free energy, represents the least amount of work one has to 
perform in order to restore the system's 'original' state, i.e., a situation that all the red 
particles are located on the left and all the green particles are on the right. However, 
if one cannot tell the difference in color, no necessary action is needed to restore the 
system's original state, since the original state and the final state appear to be the same. 

Even with such an understanding, one may still get puzzled if he considers other 
aspects of this story. For example, one would note that after the partition is removed, 
the accessible volume for each particle is twice as large as before. Since it is encouraged 
by molecular chaos that each particle should access as much volume as possible, will 
this mechanism give rise to any driving force toward mixing, that is beyond our current 
description of thermodynamics? 
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There is yet another puzzle worthy of further studies. If the partition is made of 
some fragile wall instead of an unbreakable one, one might find as time proceeds that the 
wall eventually breaks down due to collisions and the particles mix. This phenomenon 
itself indicates the existence of a time arrow [22]. which implies an increase of some 
sort of entropy. So where does this entropy increase come from? Does it come merely 
from the dissociated wall molecules, or does it include any additional contribution from 
particle mixing? 

Based on these speculations, we would like to ask whether thermodynamics, in 
particular bulk thermodynamics, gives correct prediction for such a system. Is there any 
driving force towards particle mixing? If the answer is yes, this driving force must imply 
some sort of entropy change after mixing. 

3. Analogy in a system with two colloidal particles 

For a colloidal particle in a salt-free aqueous solution, the size of its neutralizing 
counterion cloud is in the order of micrometers. Since there are about ten thousand 
neutralizing counterions surrounding each colloidal particle, the average distance among 
neighboring counterions is of several tens of nanometers, which is much larger than 
the Bjerrum length (« 7 A in aqueous solutions). Therefore the pairwise electrostatic 
interactions of counterions are rather weak, while the major force exerted on counterions 
are steric repulsions as well as the electrostatic confinement from all the other charges. 
Based on these facts we speculate that the volume-exclusive scenario as described in the 
previous section might be applied in the colloidal system. 

Consider a system of two colloidal particles (named 'macroions' from now on, to 
avoid confusion with counterion particles), each dressed with a net charge of —Ne 
on its surface and charge-compensated by +N monovalent cations in the neighboring 
solution. With no extra salt added, on average the N counterions tend to reside in a 
vicinity volume V of each macroion, and different counterion clouds do not overlap if 
the macroions sit far apart. 

In this work we shall neglect the detailed electrostatic interaction between the 
macroions and their counterions, and represent the charge compensation by the 
previously mentioned simple scheme of lattice model. In this scheme, the analogy of one 
macroion plus its iV counterions, is just N particles in a box of volume V, as illustrated 
in Fig. [H The question is, if one considers two such macroions, is there any favored 
mixing entropy as suspected in the previous section, that drives the two macroions closer 
such that their counterions mix? 

Consider a gedanken experiment in which the counterions of one macroion are 
painted 'red', while those of the other macroion are painted 'green'. Assume that the 
counterions are otherwise identical. The entropy of such a system will definitely increase 
when the macroions get closer and counterions mix. But if this serves as a driving force 
that drags the two macroions closer, it would certainly apply as well for a system where 
the counterions are monochromatic, since the underlying microscopic mechanical rules 
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(the Newtonian equations, for example) remain the same. Such an increase of entropy 
associated with color mixing merely give us a hint about how much effort is needed to 
separate the mixture back into a red counter ion cloud and a green one, while it requires 
more detailed argument to check whether there exists a driving force that drags the two 
counterion clouds closer. 

In the next section we will show, with a detailed examination, that one can prove the 
existence an extra term SS upon mixing, whether the counterions are all distinguishable 
or not. Although this residual entropy is non-extensive, it does give rise to an important 
attraction in colloidal systems. 

4. Existence of an residual entropy and like-charge attraction 

Regardless of one's impression, the dynamical behavior of the physics-wise and 
chemistry-wise identical particles must be the same, whether they are distinguishable or 
not. Keeping this in mind, we restrict our following discussion to the case in which all 
the particles are distinguishable. To continue the argument in the previous sections, let 
us consider a state A where the two macroions sit far apart such that the counterions 
could not transfer within the colloidal Brownian motion timescale, and a state B where 
the two macroions are not far apart so that the counterions can diffuse to mix (see 
Fig. [1]). According to Boltzmann's entropy formula, the entropy of the mixed final state 
is higher, which amounts to a lower Helmholtz free energy, as shown in Fig. EJ^a) (the 
internal energy is irrelevant here.) For each profile (A, I) of the initial unmixed state 
A, the entropy is Sa,i, and there exists a forward reaction rate constant kfj towards 
the mixed state B, as well as a reverse reaction rate constant k r j. The detailed-balance 
condition requires that 



where the approximation of AS is given by Eq. HI This large ratio indicates the slim 
chance for the system to restore the initial profile (A, I). On the other hand, when 
the system is in state B, there also exist numerous demixing reactions towards other 
profiles (A, I') (see Fig. EJ^b)). For the current case of two macroions, the total number 
of profiles is equal to the number of ways of bisecting 2N counterions. Thus the total 
number of paths for these demixing reactions is Q = (2N)\/(N\) 2 w 2 2N . While all 
these forward reactions share the same rate constant kf, all the reverse reactions share 
another constant k r . 

Again according to the detailed-balance condition, the total forward reaction flux 
is equal to the total reverse reaction flux at thermal equilibrium, which gives 



where Pa,{\ means the total probability of the system's staying in the bisected profiles 
of state A, and Pb is the probability of its staying in the mixed state B. Eq. [5] and 
Eq. |6]lead to the result that Pa,{} ~ Pb at "thermal equilibrium". Since exp(— F/k&T) 




(5) 




Pb ' k r • 



(6) 
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Figure 2. (a) Illustration of the free energy landscape that represents a transition 
between an arbitrary profile (A, I) of the unmixed bisected state A and the mixed 
state B. The "free energy" is obtained from the Boltzmann entropy formula for 
distinguishable particles, (b) Transitions between state B and all the profiles (yl, {}) 
of the bisected state A. 



tells about the probability up to some proportional constant, the Helmholtz free energy 
of (A, {}) and B are approximately equal. 

From the above argument one learns that at such "thermal equilibrium" the 
probability of observing bisected macroions is approximately identical to that of 
observing the macroions sitting close and counterions mixing up. 

Intriguingly enough, one finds a more accurate estimate if one would care for a 
better off description of Stirling's approximation! 
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From the exact Boltzmann's entropy definition (equalities in Eqs. HH3]), one obtains 
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which is exactly the same as the probability ratio obtained by treating all the counterions 
indistinguishable. With the refined approximation in Eq. one derives 
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So there does exist a free energy difference between the mixed and bisected states, which 
means an increase in entropy: 
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(10) 



A remarkable feature of 5S in Eq. [10] lies in the fact that it is non-extensive. Thus 
the contribution of 5S becomes irrelevant when one considers bulk thermodynamics. 
However, as we shall find in the next paragraph, for a system such as a pair of macroions 
plus their counterions, where the number of counterions surrounding each macroion is 
in the order of 10 4 , the contribution of SS is approximately 12/cb upon mixing. In other 
words, the free energy is lowered by ~ 12/cbT when the macroions approach each other. 
This is large compared with thermal fluctuations of the colloidal particles, and therefore 
the residual mixing entropy can be a crucial candidate among the sources of the effective 
like-charge attraction. 
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Figure 3. Effective packing fraction of counterions versus the Bjerrum length. We 
use the approximation that each counterion occupies a volume (I_b/2) 3 • 47r/3. 



To estimate the magnitude of this residual mixing entropy, we first approximate 
the thickness of the counterion cloud by the Debye screening length: 



k y/4:irl B ■ 2p w ' 

where p w is the density of dissociated water ions, as one has p w ~ 60pm~ 3 . As we 
estimate the size of a counterion by the Bjerrum length, which indicates the electrostatic 
strength, the corresponding volume of occupation is approximately (Zs/2) 3 • 4tt/3. Thus 
the effective packing fraction of counterions is 

Fig. [3] shows the dependence of the counterion volume fraction p c on the Bjerrum 
strength. Note that as the volume fraction approaches one, the electrostatic interaction 
among neighboring counterions becomes relevant and our simple model will fail at such 
regime. Nevertheless, as in a normal aqueous solution, where Ib ~ 7 A, p c = 6.4 x 10~ 8 , 
the distance between neighboring counterions is quite large such that the ideal-gas 
approximation can be applied in this regime. Meanwhile, our result about the residual 
entropy is presented in Fig. HI We find that 5S ~ 12.7/cb at low Bjerrum length. The 
magnitude of this residual entropy stays constant throughout the observed regime. 

The analogy we have made, between the system of two macroions with counterions 
and the scenario of the Gibbs paradox, is based on the assumption that the counterions 
cannot transfer from one cloud to the other when the macroions are far apart, as if 
there exists a partition in between. As the macroions get closer, the counterions mix, 
as if the partition is removed. Our result tells that the residual entropy is exactly 
the contribution from the number fluctuation of counterions upon mixing. Indeed, one 
could argue that such number fluctuations would possibly lead to oppositely-charged 
colloidal particles that attract each other via simple Coulomb interaction. However, we 
should keep in mind that for this Coulomb interaction to be comparable to the order 
of thermal energy, with the colloidal particle separation of a few microns, one needs to 
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Figure 4. The residual mixing entropy 5S versus the Bjerrum length. 

examine a scenario of non-neutral particles charged as much as ~ ±100e. Furthermore, 
the total electrostatic energy in such a case should also take into account the ionization 
energy as well as energy of affiliation for each counter ion jumping from one cloud to 
another, as the net electrostatic energy will be less significant. Also it has been known 
that the induced dipole-dipole interaction at such large colloidal separations is weaker 
than the repulsive DLVO potential [24J. Our mechanism of residual mixing entropy may 
provide a source for the like-charge attraction between colloidal particles, based on the 
speculation that its magnitude is comparable to the thermal energy. 

5. Conclusion 

Through a re-examination of the Gibbs paradox, we deduce the existence of a non- 
extensive residual entropy 5S upon particle mixing, even for cases where particles are 
indistinguishable. Comparing the mixing of particles in Gibbs paradox to the mixing 
of counterions in a colloidal system, we speculate that this residual entropy leads to 
an effective attraction among colloidal particles. This attraction, contributed from the 
residual entropy upon mixing, arises from the number fluctuation of counterions when 
the colloidal particles approach each other. 

Throughout our discussion, the details of electrostatic interaction are neglected 
except for the overall charge neutrality between each colloidal particle and its counterion 
cloud. Whether these details can enhance the residual entropy effect is not known yet, as 
this will be further studied in our future work. Moreover, our arguments in the previous 
sections are based on the speculation that the case where counterion clouds are far 
apart can be compared to a bisected state, due to the consideration of overall charge 
neutrality about each colloidal particle. In fact, even if the number of counterions can 
still fluctuate, our proposed mechanism of like-charge attraction may be observed as a 
nonequilibrium process. This is because it takes a relatively large time for counterions to 
diffuse over clouds, and the mixing of counterions between clouds may be incomplete over 
the observed time scale. To clarify these effects, we suggest that a thorough investigation 
via a Poisson-Boltzmann approach may help resolve this problem with better accounts. 
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Concerning the original Gibbs paradox, we conclude that the Boltzmann entropy serves 
as a good definition of the 'statistical' entropy, as it faithfully tells about the probability 
distribution and the direction of the time arrow, and leaves no paradox in the end of the 
argument. On the other hand, due to its non-extensiveness and violation of the second 
law, it does not serve as an appropriate definition of the bulk 'thermodynamic' entropy, 
despite that it still satisfies the variational statement of the second lawj25], which states 
that the entropy of a system is smaller if there exists internal constraints. 
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